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Background:  To  sustain  progress  toward  injury  reduction  and  other  health  promotion  goals, 
public  health  organizations  need  a  systematic  approach  based  on  data  and  an  evaluation  of  existing 
scientific  evidence  on  prevention.  This  paper  describes  a  process  and  criteria  developed  to  system¬ 
atically  and  objectively  define  prevention  program  and  policy  priorities. 

Methods:  Military  medical  surveillance  data  were  obtained  and  summarized,  and  a  working  group 
of  epidemiology  and  injury  experts  was  formed.  After  reviewing  the  available  data,  the  working  group 
used  predefined  criteria  to  score  leading  military  unintentional  injury  causes  on  five  main  criteria 
that  assessed  factors  contributing  to  program  and  policy  success:  (1)  importance  of  the  problem, 
(2)  effectiveness  of  existing  prevention  strategies,  (3)  feasibility  of  establishing  programs  and  policies, 
(4)  timeliness  of  implementation  and  results,  and  (5)  potential  for  evaluation.  Injury  problems  were 
ranked  by  total  median  score. 

Results:  Causes  with  the  highest  total  median  scores  were  physical  training  (34  points),  military 
parachuting  (32  points),  privately-owned  vehicle  crashes  (31  points),  sports  (29  points),  falls  (27 
points),  and  military  vehicle  crashes  (27  points). 

Conclusions:  Using  a  data-driven,  criteria-based  process,  three  injury  causes  (physical  training, 
military  parachuting,  and  privately  owned-vehicle  crashes)  with  the  greatest  potential  for  successful 
program  and  policy  implementation  were  identified.  Such  information  is  useful  for  public  health 
practitioners  and  policymakers  who  must  prioritize  among  health  problems  that  are  competing  for 
limited  resources.  The  process  and  criteria  could  be  adapted  to  systematically  assess  and  prioritize 
health  issues  affecting  other  communities. 
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Introduction 

istorically,  public  health  policy  development 
has  been  largely  driven  by  ad  hoc,  often  high- 
visibility  and  emotion-invoking,  issues  of  public 
concern.^  While  responding  to  these  issues  is  a  necessary 
component  of  public  health  practice  and  policy,  sus¬ 
tained  progress  toward  the  reduction  or  prevention  of 
leading  health  problems  requires  a  more  systematic  ap¬ 
proach  based  on  a  review  of  available  epidemiologic  data 
and  evaluation  of  the  scientific  evidence  on  existing  or 
potential  prevention  strategies. As  stated  in  the  lOM 
report.  The  Future  of  Public  Health,  public  health  policy 
development  would  benefit  most  from  “a  careful  assess- 
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ment  of  existing  knowledge,  establishment  of  priorities 
based  on  data,  and  allocation  of  resources  according  to  an 
objective  assessment  of  the  possibilities  for  greatest 
impact.”^ 

In  the  injury  prevention  field,  expert  opinion  has  been 
the  foundation  for  priority  setting  in  the  past."^“®  At  least 
one  scoring  system  has  been  developed  for  use  in  defining 
injury  prevention  priorities  that  provides  an  objective, 
quantitative  assessment  of  injury  based  on  the  frequency 
of  emergency  department  visits  by  mechanism  of  injury 
and  the  severity  of  the  injury  based  on  the  Injury  Severity 
Score/  However,  in  public  health  policy  development, 
frequency  and  severity  are  only  part  of  what  must  be 
considered  when  deciding  what  programs  and  policies  to 
implement.  Information  on  the  effectiveness  of  preven¬ 
tion  strategies,  gathered  from  existing  studies  or  system¬ 
atic  reviews,  should  also  be  considered.  Additionahy,  po¬ 
litical,  social,  and  economic  factors  influence  the  success 
or  failure  of  a  public  health  program  or  policy.  While 
many  of  these  factors  have  been  incorporated  into  sug¬ 
gested  criteria  to  evaluate  injury  programs  and  policies,®’® 
there  are  no  prioritization  processes  that  have  combined 
all  of  these  factors,  nor  are  there  published  descriptions  of 
applications  of  processes  that  combine  all  of  these  factors. 

This  paper  describes  the  application  of  a  prioritization 
process  that  includes  the  review  of  fatal  and  nonfatal 
injury  epidemiologic  data  with  the  use  of  predetermined 
criteria  and  scoring  to  obtain  an  objective,  quantitative 
assessment  of  the  degree  to  which  the  leading  causes  of 
military  injuries  are  likely  to  have  successful  program  and 
policy  implementation  in  the  U.S.  Department  of  De¬ 
fense  (DoD).  This  work  builds  on  two  prior  injury  priori¬ 
tization  efforts:  one  that  generated  injury  prevention  pri¬ 
orities  for  the  U.S.  Army  Center  for  Health  Promotion 
and  Preventive  Medicine’s  Injury  Prevention  Pro- 
gram®’^°  and  another  that  produced  injury  prevention 
priorities  for  the  DoD.“  Rationale  and  background  on 
the  development  of  this  process  are  explained  in  detail  by 
Jones  et  al.^  The  purposes  of  the  prioritization  initiative 
described  in  this  paper  were  to  (1)  refine  previous  priori¬ 
tization  efforts  by  utilizing  input  from  experts  with  public 
health  training  and  experience  evaluating  epidemiologic 
data  and  the  scientific  literature;  and  (2)  to  apply  pre¬ 
defined  criteria  to  identify  top  DoD  injury  causes  most 
amenable  to  implementation  of  prevention  programs 
and  policies. 

Methods 

This  initiative  began  in  April  2006  with  the  formation  of  the 
Military  Injury  Epidemiology  and  Prevention  Priorities 
Working  Group  (MIEPPWG),  established  under  the  Mili¬ 


tary  Training  Task  Force  of  the  Defense  Safety  Oversight 
Council.  The  working  group  consisted  of  18  faculty  and 
graduate  student  volunteers  from  the  Uniformed  Services 
University  of  the  Health  Sciences  (USUHS).  Its  mission  was 
to  review  and  assess  existing  nonbattle  medical  surveillance 
and  field  investigation  data  to  identify  the  largest  and  most 
preventable  DoD  unintentional  injury  problems  that,  if  ad¬ 
dressed,  had  the  greatest  potential  to  rapidly  reduce  military 
injury  rates. 

Available  epidemiologic  data  were  obtained.  Aggregate 
data  on  nonfatal,  non-deployment-related  inpatient  and 
outpatient  medical  encounters,  as  recorded  in  the  Defense 
Medical  Surveillance  System  (DMSS),^®  were  requested 
from  the  Armed  Forces  Health  Surveillance  Center  (for¬ 
merly,  the  Army  Medical  Surveillance  Activity).  Graphic 
representations  and  data  summaries  were  prepared  by  the 
U.S.  Army  Center  for  Health  Promotion  and  Preventive 
Medicine,  examples  of  which  are  presented  elsewhere. 
Summaries  included  descriptions  of  injury-related  medical 
encounters  in  relation  to  other  health  problems,  inpatient 
(hospitalization)  and  outpatient  injury  rates  over  time,  and 
leading  injury  types  and  causes  of  hospitalizations  among 
active  duty  military  personnel  (all  Services)  between  2003 
and  2005.  Given  that  activities  and  causes  associated  with 
outpatient  injuries  were  not  routinely  coded  in  the  medical 
data,  cause  of  injury  information  from  field  investigations, 
where  information  on  causes  of  outpatient  visits  were  cap¬ 
tured  from  medical  record  reviews,  were  also  summa- 
rized.^®“^^  Frequencies  of  active  duty  service  member  fatal¬ 
ities  by  type  (i.e.,  accident,  illness,  hostile  action,  other 
intentional)  were  obtained  from  the  Office  of  the  Armed 
Forces  Medical  Examiner  for  all  Services  for  2003  and  2004. 

During  a  1-day  meeting,  MIEPPWG  members  were  pre¬ 
sented  with  the  epidemiologic  data  described  above.  Work¬ 
ing  group  members  then  reviewed,  discussed,  and  reached 
consensus  on  how  they  interpreted  the  previously  estab¬ 
lished  criteria  for  prioritizing  injury  programs  and  policies 
(Table  1)  2.3.10.18  pQiiQ.^^ij^g  meeting,  working  group 
members  completed  the  prioritization  process.  Worksheets 
were  completed  independently,  then  submitted  to  the  lead 
author  (MCC)  for  compilation.  Worksheets  were  completed 
for  each  of  the  following  leading  causes  of  military  injuries: 
falls/jumps,  crashes  of  privately  owned  motor  vehicles  (in¬ 
cludes  trucks,  cars,  motorcycles),  physical  training,  sports, 
guns/explosives,  military  parachuting,  twists/turns/slips 
without  fall,  military  motor  vehicle  crashes,  nontraffic  mo¬ 
tor  vehicle  incidents,  and  machinery/tools.  These  cause  cat¬ 
egories  were  consistent  with  the  NATO  military  injury  cause 
coding  system,^®  which  is  employed  by  the  U.S.  military 
health  system  to  cause-code  injury  hospitalizations.  Nine  of 
these  ten  causes  were  identified  from  medical  surveillance 
data  as  the  leading  causes  of  unintentional  injury  hospital¬ 
izations  for  the  leading  causes  of  DoD  injury  types  among 
active  duty  military  personnel  in  2004.^®  Physical  training 
was  included  based  on  evidence  that  approximately  half  of 


www.ajpm-online.net 


Canham-Chervak  et  al/  Am  J  Prev  Med  2010;38(1S):S11-S18 


S13 


Table  1.  Criteria  for  prioritizing  injury  causes  amenable  to  prevention  programs  and  policies 


Criterion 

Preliminary  rating 

Final  score 

A.  Consistent  with  the  mission  of  the  agency/organization/working  group 

[]YES 
[  ]  NO 

If  YES — Continue  with  scoring. 

If  NO — Stop  here. 

B.  importance  of  problem  to  health  and  readiness  (10  points) 

Considerations: 

(10  points;  l=iow,  10= high) 

1.  Magnitude  of  the  problem  (e.g.,  frequency,  incidence) 

1. 

[  ]  Low  [ 

]  Medium  [ 

]  High 

2.  Severity  of  problem  {e.g.,  injury  diagnosis,  length  of  stay  or  recuperation) 

2 

[  ]  Low  [ 

]  Medium  [ 

]  High 

3.  Cost  of  the  problem  (e.g.,  medical,  training,  property,  and  personnel  costs 
such  as  lost  work  time) 

3. 

[  ]  Low  [ 

]  Medium  [ 

]  High 

4.  Size  of  population  at  risk 

4. 

[  ]  Low  [ 

]  Medium  [ 

]  High 

5.  Degree  of  concern  (e.g.,  leadership  concern,  public  and  Service  member 
concern,  visibility  of  problem) 

5. 

[  ]  Low  [ 

]  Medium  [ 

]  High 

C.  Preventability  of  problem  (10  points) 

Considerations: 

(10  points;  l=low,  10=high) 

1.  Cause{s)  are  identifiable 

1. 

[  ]  Low  [ 

]  Medium  [ 

1  High 

2.  Risk  factors  are  modifiable 

2. 

[  ]  Low  [ 

]  Medium  [ 

]  High 

3.  Proven  prevention  strategies  that  reduce  existing  injury  rates  exist® 

3. 

[  ]  Low  [ 

]  Medium  [ 

]  High 

4.  Prevention  strategies  that  reduce  existing  injury  rates  can  be  designed 

4. 

[  ]  Low  [ 

]  Medium  [ 

]  High 

5.  Effect  size 

5. 

[  ]  Low  [ 

]  Medium  [ 

]  High 

D.  Feasibility  of  program  or  policy  (10  points) 

Considerations: 

(10  points;  l=low,  10=high) 

1.  Existence  of  infrastructure  to  support  implementation  and  sustainability  of 
the  program  or  policy  (e.g.,  medical  staff  and  facilities,  safety  staff  and 
resources) 

1. 

[  ]  Low  [ 

]  Medium  [ 

]  High 

2.  Perceived  adequacy  of  funding  to  support  implementation  and  sustainability 

2. 

[  ]  Low  [ 

]  Medium  [ 

]  High 

3.  Authority  to  implement  and  sustain  the  program  or  policy  is  held  or 
obtainable  by  the  implementing  organization(s) 

3. 

[  ]  Low  [ 

]  Medium  [ 

]  High 

4.  Program  or  policy  will  not  undermine  essentia!  missions 

4. 

[  ]  Low  [ 

]  Medium  [ 

]  High 

5.  Political  and  cultural  acceptability  of  program  or  policy 

5. 

[  ]  Low  [ 

]  Medium  [ 

]  High 

6.  Accountability  and  responsibility  for  implementation  and  sustainability  exists 
or  can  be  established 

6. 

[  ]  Low  [ 

]  Medium  [ 

]  High 

E.  Timeliness  (5  points) 

Considerations: 

(5  points;  l=low,  5=high) 

1.  Implementation  time‘s 

1. 

[  ]  Low  [ 

]  Medium  [ 

]  High 

2.  Results  time‘s 

2. 

[  ]  Low  [ 

]  Medium  [ 

]  High 

F.  Evaluation  of  program  or  policy  (5  points) 

Considerations: 

(5  points;  l=low,  5=high) 

1.  Abiiity  to  evaluate  effects  of  program  or  policy  exists  (i.e.,  if  a  metric  is 
possible) 

1. 

[  ]  Low  [ 

]  Medium  [ 

]  High 

2.  Benefits  of  program  or  policy  outweigh  the  costs  of  implementation  and 
sustainability 

2. 

[  ]  Low  [ 

]  Medium  [ 

]  High 

3.  Collateral  benefits  as  a  result  of  implementation  (e.g.,  increased  readiness, 
decreased  attrition,  and  decreased  other  health  problems) 

3. 

[  ]  Low  [ 

]  Medium  [ 

]  High 

Total  score 

®lf  systematic  reviews  substantiate  effectiveness  of  a  prevention  strategy,  score  as  10  points  automatically. 

'^Assign  higher  value  to  programs  and  policies  with  shorter  implementation  and  time  to  desired  results. 

Instructions:  Complete  a  scorecard  for  each  injury  problem  under  consideration.  First,  provide  a  preliminary  rating  for  each  of  the  Considerations  listed  under  each 
criterion.  Then,  using  the  preliminary  ratings  as  a  guide,  assign  a  final  score  for  each  criterion.  For  criteria  B,  C,  and  D,  assign  a  final  score  from  1  to  10  (l=lowest 
score,  10=  highest  score).  For  criterion  E  and  F,  assign  a  final  score  from  1  to  5  (l=lowest  score,  5=highest  score).  Adding  the  final  scores  will  provide  a  total 
score,  with  a  maximum  of  40. 
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injuries  occurring  among  active  duty  service  members  were 
lower  extremity-  overuse  injuries/"*  the  majority  of  which  in 
military  populations  are  attributed  to  physical  training/"*’^^ 
Medical  surveillance  data  reports  indicated  that  causes  of 
injury  hospitalizations  did  not  vary  substantially  from 
2000-2004/°“^^ 

Table  1  presents  the  complete  worksheet  and  criteria  used 
to  rate  each  injury  cause.  The  process  first  required  consid¬ 
eration  of  whether  adoption  of  programs  or  policies  related 
to  the  injury  issue  was  consistent  with  the  mission  of  the 
agency  applying  the  scoring  criteria  (i.e.,  the  working 
group’s  mission).  The  medical  surveillance  and  field  inves¬ 
tigation  data  provided  to  working  group  members  were  used 
to  rate  the  importance  of  the  problem  (Criterion  B).  Prevent- 
ability,  feasibility  of  prevention,  timeliness,  and  evaluation- 
potential  (Criteria  C-F)  assessments  relied  on  individual 
knowledge  and  experience.  A  preliminary  score  of  low,  me¬ 
dium,  or  high  was  assigned  to  21  factors,  or  “consider¬ 
ations,”  within  the  five  main  criteria  (Criteria  B-F).  Work¬ 
ing  group  members  considered  preliminary  ratings  of  each 
“consideration”  in  determining  a  final  numeric  score  for  the 
main  criterion.  Main  criteria  given  a  higher  “weight”  in  the 
process  (importance  of  the  problem,  preventability,  and  fea¬ 
sibility)  were  scored  from  1  to  10,  and  main  criteria  given  a 
lower  “weight”  (timeliness  and  evaluation  potential)  were 
scored  from  1  to  5.  These  weights  were  adopted  from  previ¬ 
ous  work.^’*°’** 

Causes  were  ranked  using  the  median  total  score  of  each 
injury  cause.  Median  values  were  chosen  for  ranking  in 
order  to  avoid  the  potential  effects  of  scoring  variability,  as 
might  be  experienced  with  use  of  mean  values.  The  higher 
the  score,  the  stronger  the  indication  that  the  injury  cause 
was  amenable  to  program  and  policy  implementation. 


^Maximum  score  =  10 
“’Maximum  score  =  5 

“Sum  of  median  scores  across  criteria,  maximum  score=40 
iR,  interquartiie  range 


Results 

Nine  members  of  the  working  group  (50%)  volunteered 
to  participate  in  the  full  prioritization  process.  Nonpar¬ 
ticipants,  44%  of  whom  were  graduate  students,  cited 
“lack  of  time”  as  the  primary  reason  for  not  choosing  to 
participate.  Members  who  contributed  to  the  prioritiza¬ 
tion  process  were  all  trained  at  the  doctorate  level  in  one 
or  more  of  the  following  disciplines:  behavioral  science, 
preventive  medicine/epidemiology,  occupational  medi¬ 
cine,  family  medicine,  health  services  administration,  in¬ 
ternal  medicine,  orthopaedic  surgery,  sports  medicine,  or 
military  medicine.  Six  of  the  nine  were  also  formally 
trained  in  public  health.  Five  participants  were  active 
duty  military,  two  were  retired  military,  and  two  were 
civilian  academic  researchers  employed  by  the  military. 

The  highest  possible  total  median  score  was  40.  Physi¬ 
cal  training  received  the  highest  score  (34),  followed  by 
military  parachuting  (32),  privately-owned  vehicle 
crashes  (31),  sports  (29),  falls  (27),  and  military  vehicle 
crashes  (27)  (Table  2).  Physical  training  and  privately 
owned-vehicle  crashes  had  the  highest  median  score 
(9  points)  for  importance  of  the  problem.  Military  para¬ 
chuting  had  the  highest  median  score  (10  points)  for 
preventability  of  the  problem  and  evaluation  potential 
(5  points).  Physical  training  and  tools/machinery  had  the 
highest  median  scores  (8  points)  for  feasibility;  physical 
training,  military  parachuting,  and  sports  had  the  highest 
median  scores  (4  points)  for  timeliness. 

Tools/machinery  and  nontraffic  vehicle  incidents, 
compared  to  all  other  causes,  had  the  lowest  median  score 


Table  2.  Prioritization  results:  median  scores  for  five  main  criteria,  total  score,  and  rank  order  by  cause  of  injury 


Causes  of  injury 

Importance^  Preventability^  Feasibility^  Timeiiness'’  Evaluation  Total 

median  (IR)  median  (IR)  median  (IR)  median  (IR)  potential'’  score' 

median  (IR) 

Rank 

Physical  training 

9  (8,  10) 

9  (7,  10) 

8  (6,  9) 

4(3,5) 

4  (4,  5) 

34 

1 

Military  parachuting 

6(3,7) 

10  (6,  10) 

7  (5,  9) 

4  (4,  5) 

5  (4,  5) 

32 

2 

Privately-owned  vehicle  crashes  9  (8,  9) 

8  (7,  10) 

7  (5,  8) 

3  (2,  4) 

4  (3,  4) 

31 

3 

Sports 

7(7,9) 

7  (6,  8) 

7  (5,  8) 

4(3,  4) 

4  (4,  5) 

29 

4 

Falls 

7  (6,  8) 

7  (5,  8) 

6  (6,  7) 

3  (3,  3) 

4  (3,  4) 

27 

5 

Military  vehicle  crashes 

7  (7,  8) 

7  (6,  9) 

6  (4,  8) 

3  (3,  4) 

4  (3,  4) 

27 

5 

Guns  and  explosives 

7  (5,  8) 

7  (6,  9) 

6  (5,  8) 

3  (3,  4) 

3(2,5) 

26 

7 

Tools  and  machinery 

5(5,6) 

6(5,9) 

8  (5,  8) 

2  (2,  4) 

3  (3,  4) 

24 

8 

Twists/turns  (without  fall) 

6(5,7) 

5  (3,  6) 

5  (4,  7) 

3  (2,  4) 

3(2,3) 

22 

9 

Nontraffic  vehicle  incidents 

5  (5,  8) 

6  (4,  8) 

4  (3,  7) 

2  (2,  4) 

3(2,4) 

20 

10 
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for  importance  of  the  problem  (5  points)  and  timeliness 
(2  points).  Twist/turns  had  the  lowest  median  score  for 
both  preventability  and  feasibility  (5  points).  Tools/ma¬ 
chinery  and  nontraffic  vehicle  incidents  had  the  lowest 
median  score  for  timeliness  (2  points),  and  four  injury 
causes  (guns/explosives,  tools/machinery,  twists/turns, 
nontraffic  vehicle  incidents)  received  the  lowest  median 
score  for  evaluation  potential  (3  points). 

Discussion 

This  paper  describes  a  process  that  produced  a  prioritized 
list  of  injury  causes  that  can  be  used  to  inform  and  guide 
public  health  practitioners  and  policymakers  who  need  to 
prioritize  health  problems  that  are  competing  for  limited 
program  resources.  The  results  indicated  that  the  top  three 
injury  causes  most  likely  to  have  successful  program  and 
policy  interventions  in  the  DoD  were  physical  training,  mil¬ 
itary  parachuting,  and  privately-owned  vehicle  crashes. 

The  emergence  of  physical  training  as  the  top  priority  for 
program  and  pohcy  intervention  is  not  surprising.  Investi¬ 
gations  of  U.S.  Army  active  duty  populations  have  shown 
physical  training-related  injuries  to  be  the  leading  cause  of 
injuries,  accounting  for  25%-50%  of  all  injury  vis¬ 
its.  Among  Marine  Corps  recruits,  higher  frequen¬ 

cies  of  vigorous  physical  training  have  been  correlated  with 
higher  musculoskeletal  injury  rates.^^  Among  the  other 
Services,  surveillance  of  training-related,  lower  ex¬ 
tremity  overuse  injuries  has  indicated  that  such  injuries, 
which  are  largely  training-related,^'*’^^  account  for  ap¬ 
proximately  50%  of  the  Service-specific  total  injury  bur¬ 
dens.*'*  These  numbers  suggest  that  the  frequency  and 
incidence  of  the  problem  is  large.  Given  that  all  Service 
members  must  also  maintain  specified  levels  of  physical 
fitness,  the  size  of  the  population  potentially  affected  by 
physical  training-related  injuries  is  also  large.  Prevent¬ 
ability  of  physical  training-related  injuries  was  rated  high 
because  there  are  proven  prevention  strategies  (e.g., 
avoiding  overtraining,  conducting  agility-like  training, 
use  of  mouthguards)^**  that  could  be  adopted  immedi¬ 
ately  to  reduce  physical  training-related  injuries.  In  the 
United  States  (U.S.)  Army  a  standardized  physical  train¬ 
ing  program  that  avoids  overtraining  and  utilizes  agility¬ 
like  training  has  been  found  to  reduce  physical  training- 
related  injuries  while  meeting  desired  physical  fitness 
goals. Given  that  the  ability  to  evaluate  such  pro¬ 
grams  has  been  previously  demonstrated,^*’^^  the  evalu¬ 
ation  potential  for  physical  training  received  the  maxi¬ 
mum  score  (5). 

Military  parachuting  injuries,  ranked  second  in  this 
process,  can  be  severe  and  numerous;^^  however,  they 
affect  a  relatively  small  subset  of  the  military  and  predom¬ 
inantly  one  Service  (Army)  only.  As  a  result,  this  injury 


cause  scored  lower  than  other  causes  on  the  importance 
of  the  problem.  Evaluations  have  demonstrated  that  an 
effective  prevention  measure  exists  (i.e.,  an  external 
parachute  ankle  brace),  that  would  be  expected  to  re¬ 
duce  the  incidence  of  the  most  common  injuries 
among  airborne  personnel,  ankle  sprains  and  frac¬ 
tures,  by  50%-  80%.^“*"^®  This  combination  of  factors  led 
to  high  preventability  and  timeliness  scores  for  “military 
parachuting.”  Ankle  injury  risk  has  been  shown  to  be  1.6 
to  2.9  times  higher  among  paratroopers  who  did  not  wear 
an  ankle  brace  compared  to  those  who  did  wear  a  brace.^^ 
These  evaluations  also  demonstrate  that  it  is  feasible  to 
implement  and  to  evaluate  the  effects  of  this  intervention 
in  military  populations,  contributing  to  higher  criterion 
scores  in  these  areas.  The  high  preventability,  feasibility, 
timeliness,  and  evaluation  scores  in  the  prioritization 
process  resulted  in  a  high  ranking  for  this  injury  issue. 

Privately-owned  vehicle  crashes,  which  received  the 
third-highest  rank  in  the  prioritization  process,  have  his¬ 
torically  been  a  leading  cause  of  mortality  and  morbidity 
among  military  service  members. Each  year,  “land 
transport”  is  noted  as  a  leading  cause  of  DoD  injury 
hospitalizations,  representing  9.1%-18.7%  of  all  injury 
hospitalizations  (2000-2006)  with  a  valid  injury  cause 
code.^°“^^’'*°“'‘^  Safety  data  have  also  indicated  that  59%, 
64%,  61%,  and  55%  of  unintentional  injury  deaths  for  the 
U.S.  Army,  Navy,  Marine  Gorps,  and  Air  Force,  respec¬ 
tively,  were  due  specifically  to  privately-owned  vehicle 
crashes.'*^  Based  on  these  and  other  statistics,  privately- 
owned  vehicle  crashes  scored  high  on  importance  of  the 
problem.  The  availability  of  recent  systematic  reviews  of 
prevention  strategies  such  as  graduated  licensing,  de¬ 
creasing  alcohol-impaired  driving,  and  increasing  seat 
belt  use'*'*"'*®  contributed  to  its  high  preventability  score. 
High  scores  on  both  of  these  measures — importance  and 
preventability —  ultimately  contributed  to  the  high  rank¬ 
ing  of  the  privately-owned  vehicle  crashes  in  the  prioriti¬ 
zation  process. 

Of  note,  falls  did  not  rank  as  one  of  the  top  three  injury 
program  and  policy  priorities,  despite  annual  documenta¬ 
tion  showing  falls  to  be  the  leading  cause  of  active  duty 
military  injury  hospitalizations,  accounting  for  nearly  one 
fifth  of  all  injury  hospitalizations  each  year.^**"^^’'***"'*^  The 
lower  ranking  of  falls  as  a  prevention  priority  is  partially 
explained  by  the  dearth  of  descriptive  and  analytic  epidemi¬ 
ology  identifying  modiftable  causes  and  risk  factors  of  falls  in 
military  and  other  working-age  populations.  As  a  conse¬ 
quence,  there  are  also  few  evaluated  interventions  in  the 
literature  for  the  prevention  of  falls  in  military  and  other 
working-age  populations."*^ 

The  prioritization  process  described  had  a  number  of 
strengths.  First,  it  attempted  to  minimize  bias  through 
use  of  quantiftable,  objective  measures.  Objectivity  was 
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built  into  the  process  by  requiring  the  review  of  available 
epidemiologic  data  to  rate  the  importance  of  the  problem 
and  by  the  use  of  a  worksheet,  which  forced  consideration 
of  all  predetermined  criteria  and  enhanced  the  visibility 
of  working  group  members’  preliminary  ratings  and  final 
scores.  Second,  as  has  been  recommended,'*®  the  data 
reviewed  were  not  limited  to  mortality  data.  Rather, 
working  group  members  also  reviewed  and  formulated 
their  rating  based  on  data  on  the  more  numerous  nonfatal 
injuries  and  their  causes.  Third,  the  criteria  were  similar 
to  those  suggested  or  used  elsewhere,®’®’*®"^*  and  ensured 
consideration  of  key  factors  felt  to  influence  the  success  or 
failure  of  program  and  policy  efforts.  Finally,  the  scoring 
system  and  analysis  provided  a  simple  and  straightfor¬ 
ward  mechanism  to  weight  and  score  those  key  factors. 
These  criteria  and  weights  could  be  easily  modified  to  suit 
the  specific  needs  and  considerations  of  other  communi¬ 
ties.  While  a  quantitative  process  may  not  be  absolutely 
necessary,®  it  was  felt  that  the  commitment  to  a  weight 
and  score  forced  participants  to  consider  each  factor  dur¬ 
ing  the  process.  In  addition,  while  an  alternative  analysis 
method^^  was  considered,  it  was  ultimately  not  reported, 
given  the  desire  for  a  methodology  that  was  easy  to  un¬ 
derstand  and  apply  in  public  health  practice,  and  that 
there  was  no  difference  in  the  results  obtained  by  this 
alternative,  more  complex  method. 

These  criteria,  worksheet,  and  process  could  also  in¬ 
form  future  enhancements  of  existing  processes  to  prior¬ 
itize  prevention  research.  Criteria  to  prioritize  re¬ 
search  should  include  similar  considerations,  such  as  the 
magnitude  and  severity  of  the  problem  and  adequacy  of 
resources,  but  should  also  consider  the  existence  of  gaps 
in  knowledge  (i.e.,  the  absence  of  “proven”  prevention 
strategies)  and  availability  of  research  partners.^  Estab¬ 
lishment  of  a  public  health  research  agenda  (i.e.,  research 
priorities)  that  consider  public  health  program  and  policy 
needs  is  needed  to  improve  the  effectiveness  of  our  public 
health  system. 

Opportunities  for  improvements  to  the  process  in¬ 
clude  involving  the  raters  earlier  in  the  process,  so  that 
they  have  input  into  the  final  criteria  and  methods  used. 
In  addition,  preventive  medicine  and  public  health,  like 
clinical  medicine,  have  become  increasingly  focused  on 
the  importance  of  identifying  evidence-based  practices 
prior  to  implementation.®®’^^  The  rigor  of  the  process 
could  be  further  enhanced  by  requiring  de  novo  system¬ 
atic  reviews  of  the  literature  on  program  effectiveness 
rather  than  relying  on  expert  opinion  to  define  prevent- 
ability,  feasibility,  timeliness,  and  evaluation  potential. 
However,  systematic  reviews  are  time-consuming  and 
not  always  feasible  in  public  health  practice.®  The  desire 
for  evidence-based  decisions  must  be  balanced  with  the 
need  for  a  timely  response.  Expedited  review  processes. 


such  as  described  by  Bullock  et  al.,®°  could  assist  with 
striking  this  balance. 

A  limitation  of  the  results  of  this  process  is  its  basis  on 
causes  of  injury  hospitalizations.  At  the  time  this  priori¬ 
tization  process  was  conducted,  outpatient  injury  cause 
coding  was  inconsistent  and  incomplete.  The  ability  to 
quantify  outpatient  causes  of  injuries  would  alter  the 
information  available  for  ranking  the  importance  of  the 
problem  (Criteria  B).  Improvements  in  outpatient  injury 
cause  coding  would  warrant  repetition  of  this  process,  as 
prioritization  results  may  differ  with  the  addition  of  this 
information.  Additionally,  repetition  of  this  process  is 
recommended  every  5-10  years,  to  account  for  other 
changes  over  time,  such  as  additions  to  the  medical  and 
public  health  literature. 

In  summary,  this  process  was  designed  to  produce  a  list 
of  injury  prevention  priorities  through  a  systematic  and 
objective  rating  of  the  degree  to  which  the  leading  causes 
of  DoD  injuries  were  amenable  to  program  and  policy 
implementation.  Its  use  is  not  limited  to  the  military, 
however.  In  both  military  and  civilian  public  health  orga¬ 
nizations,  establishing  data-driven  prevention  program 
and  policy  priorities  can  provide  a  focus  for  work  and 
continued  progress  toward  injury  reduction  goals  when 
not  responding  to  urgent  public  health  concerns.  The 
process  also  should  not  be  limited  to  use  in  the  injury 
prevention  field;  the  criteria  and  worksheet  could  be 
adapted  and  applied  to  prioritize  implementation  of 
other  public  health  programs  and  policies.  Such  system¬ 
atic  approaches  to  prioritizing  scarce  public  health  re¬ 
sources  are  necessary,  as  Dr.  William  Haddon,  Jr.  ex¬ 
pressed,  in  order  to  avoid  “inappropriate  choices  of 
emphasis”  that  “dissipate  funds,  time,  and  public  concern 
that  might  be  applied  to  more  effective  measures.”®® 
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